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DETAILED ACTION 

1. Claims 15-34 are pending in this application. 

Priority 

2 Acknowledgement is made of application's claim for foreign priority under 35 U.S.C. 119 
(a)-(d) based on the Germany patent application No.10301898.0 filed on 01/17/2003. 

Drawings 

3. The drawings filed on 07/18/2005 are accepted for examination 

Response to Argument 

4. Applicants' response to the last Office Action, filed, on 07/21/2009 has been entered and 
made of record. 

5. Applicants' amendment has required new grounds of rejection. New grounds rejection is 
therefore presented in the Office Action. 

6. Applicant's arguments have been fully considered but are moot in view of the new 
ground (s) of rejection. 
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Claim Rejections - 35 USC §103 

The following is a quotation of the 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

(a) A patent may not be obtained thought the invention is not identically disclosed or described as set forth in section 102 
of this title, if the difference between the subject matter sought to be patented and the prior art are such that the subject 
matter as a whole would have been obvious at the time the invention was made to a person having ordinary skill in the art 
to which said subject matter pertains. Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 15-34 are rejected under 35 U.S.C 103 as being unpatentable over Szeliski, 

Richard (hereafter Szeliski) WO 0078038 A 1 published on December 21, 2000, in view of 
Lin; Qian (hereafter Li), US Patent No US 5812286 A published on Sep.22, 1998, further in 
view of Van de Poel et al(hereafter Van de Poel), US Patent No. 6061091, published on 
May 9, 2000. 

As to claim 15, Szeliski teaches A method for adjusting a characteristic curve of exposure 
sensitivity (Abstract, A system and method for manipulating a set of images of a static 
scene captured at different exposures to yield a composite image with improved 
uniformity in exposure and tone. The cumulative distribution function is then used to 
determine new pixel brightness levels for use in generating the composite image. The 
characteristic curve corresponds to the cumulative distribution function curve (see 
Fig.8A)) of at least one pixel of at least one image sensor (Abstract: desired composite 
image can be produced by summing the pixel brightness levels across the multiple 
images captured by adjusting the up and down exposure sensors of the camera 55. The 
image sensor corresponds to the Kodak DCS-488 camera which has the exposure 
sensors), in a motor vehicle, the characteristic curve being formed in segments of functions 
(Abstract: histogram equalization involves creating a count of the number of pixels sets 
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having the same summed brightness level. From this count, a cumulative distribution 
function is computed. Thus the cumulative distribution function is a piecewise continuous 
(segmented) functions) the method comprising: 

imaging a scene (Fig. 1A-1c) using the at least one image sensor (Abstract: multiple 
images with different brightness level can be captured by adjusting the up and down 
exposure sensors of the camera 55); 

adjusting the characteristic curve of the exposure sensitivity as a function of image signals 
(page 13 lines 8-18; histogram equalization is a process for mapping pixel brightness 
values of an image to approximate a uniform distribution. Thus, distribution function is 
adjusted based on the image signal produced by the camera 26) from at least a part of the 
scene registered (Figs. 1 A-IC: FIGS. 1A through IC are images depicting an office scene 
captured at different exposure settings) by the at least one image sensor (page 8 lines 8-18, 
a camera 55 capable of capturing a sequence of images 56 with different exposures by 
adjusting its the up and down the exposure sensors. The image sensor corresponds to 
the Kodak DCS-488 camera which has up and down exposure sensors (see page 1 line 
25); 

However, it is noted that Szeliski does not specifically teach " a frequency of the gray values 
which is a number of pixels within an image that have the gray values based on a total number 
of pixels of at least a part of the histogram of image signals from the at least one image sensor 
of the at least one part of the registered scene, is approximately constant; and so that the gray 
value density, which is a sum of frequencies of the gray values in an interval of gray values in 
reference to the interval of at least a part of the histogram of image signals from the at least one 
image sensor of the at least one part of the registered scene- is approximately constant. 
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However it is noted that Szeliski does not specifically teach "a frequency of the gray values 
which is a number of pixels within an image that have the gray values based on a total number 
of pixels of at least a part of the histogram of image signals from the at least one image sensor 
of the at least one part of the registered scene is approximately constant; the gray value density, 
which is a sum of frequencies of the gray values in an interval of gray values in reference to the 
interval of at least a part of the histogram of image signals from the at least one image sensor of 
the at least one part of the registered scene is approximately constant;" although Szeliski 
strongly suggests the histogram equalization involves creating a count of the number of 
pixels sets having the same summed brightness level (page 3 lines 5-18 and lines 28-22). 
If the images are black and white, the pixel gray level could be used. The frequency of the 
gray values corresponds to the number of pixels sets having the same summed 
brightness level, signals from the at least one image sensor corresponds the signal 
generated by the stop up and down exposure sensors of the Kodak camera (page 1 lines 
21-25), the at least one part of the registered scene (Fig. 1A-IC: FIGS. 1A through IC are 
images depicting an office scene captured at different exposure settings), approximately 
constant (page 1 lines 10-11, the office scene captured at different exposure settings are 
static (constant) scene taken at different exposures). 

On the other hand the automatic color processing to correct hue shift and incorrect exposure 
of Lin teaches a frequency of the gray values which is a number of pixels within an image that 
have the gray values based on a total number of pixels of at least a part of the histogram of 
image signals from the at least one image sensor of the at least one part of the registered scene 
is approximately constant (Figs. 3-5,8, Fig. 4 illustrates histogram of a scanned image, Fig. 
5 illustrates a cumulative gray level histogram of the scanned image, and Fig.8 illustrates 
the histogram of the corrected image shown in FIG. 5. Further both the histogram graph 
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(Fig. 4) and the histogram of the corrected image graph (Fig. 8) are plotted pixel count 
verse gray level. Further Fig. 4 and Fig. 8 contain linear curves with very gentle slope 
(almost zero slope ), and clearly the pixel count is approximately constant where the 
slope of the histogram graph is gentle). 

It would have been obvious to one of ordinary skill in the art the time of invention was made 
to incorporate the automatic color processing to correct hue shift and incorrect exposure of Lin 
into the system and process for improving the uniformity of the exposure and tone of a digital 
image, because both Szeliski and Lin are directed to color correction of digital display media 
such as digital camera and scanner based on histogram of the acquired image(Line: Abstract, 
Szeliski :Abstract, page 3 lines 20-25). 

It would have been obvious to one of ordinary skill in the art to incorporate the teaching of 
automatically correcting based on the histogram of the acquired image, because that would 
have allowed user of Szeliski to correct hue shift and incorrect exposure in scanner and digital 
camera, more efficiently(Lin col. I lines 52-55) 

However, it is noted that both Szeliski and Lin do not specifically "teach the gray value 
density, which is a sum of frequencies of the gray values in an interval of gray values in 
reference to the interval of at least a part of the histogram of image signals from the at least one 
image sensor of the at least one part of the registered scene is approximately constant" 
although Szeliski suggests the aim of a histogram equalization is that obtaining an equally- 
gray- value distribution density. In mathematic terms the density is the slope of the 
cumulative distribution function. Therefore, the derivative of the cumulative distribution 
function (CDF) gives the probability density function (PDF) or the gray value density 
function of the histogram. Thus the gray value density, the gray value- density 
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corresponds to the slope of the cumulative distribution function (CDF). In addition the 
slope of CDF graph (see Fig. 8B) is approximately constant since the graph is 
approximately linear. Therefore, the gray value density is also approximately constant. 

On the other hand the Detection of and correction for specular reflections in digital image 
acquisition of Van de Poel teaches the gray value density, which is a sum of frequencies of the 
gray values in an interval of gray values in reference to the interval of at least a part of the 
histogram of image signals from the at least one image sensor of the at least one part of the 
registered scene is approximately constant(Figs. 2 and 3, col. 9 lines 36-60, Van de Poel 
specifically teaches a method of obtaining a cumulative frequency of density function 
Y=C(x) as a function of gray density level X ( see Fig.3). The function Y=C(x) is 
obtained from the density frequency function Y=H(X) as shown in Fig. 2. The Y-axis of the 
cumulative frequency density function Y=C(X)represents a cumulative frequency (sum of 
frequencies) of occurrence, and the X-axis represents density level X, wherein positive 
density X levels represent grey levels up to black(col. 3 lines 50-55). Further, the density 
function Y=C(x) includes speculate reflections section where the cumulative frequency 
density (the sum of frequencies between in the interval X1 and X2) is almost constant) . 

Notes: The cumulative frequency is the running total of the frequencies . On a graph, it can be 
represented by a cumulative frequency polygon, where straight lines join up the points, or a cumulative 
frequency curve (see for instant math revision net: Histograms and Cumulative Frequency at 
http://www.mathsrevision.net/alevel/pages.php?page=71) 

It would have been obvious to one of ordinary skill in the art the time of invention was made 
to incorporate the detection of and correction for specular reflections in digital image acquisition 
of Van de Poel into the combined method of Szeliski and Lin, because all Szeliski, Lin and Van 
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de Poel are directed to histogram based digital image correction (Van de Poel: Abstract, Line: 
Abstract, Szeliski: Abstract, page 3 lines 20-25) 

It would have been obvious to one of ordinary skill in the art to incorporate the teaching of 
Image processing parameters for gradation correction of a digital image from a scene of Van de 
Poel into the combined method of Szeliski and Lin, because that would have allowed user of 
Szeliski to detect whether or not specular reflections are present in the scene, the image of 
which must be digitized, and to provide a method for computing a gradation curve(Abstract, col. 
3 lines 30-40) suitable for correction of a digital image, in which specular reflections occurred, 
and give a suitable parameters for setting an optimal exposure time (Abstract)). 

As to claim 16, Szeliski teaches the characteristic curve of the exposure sensitivity is 
adjusted as a function of image signals (page 14 lines 16-17, a cumulative distribution 
function is computed using the summed brightness histogram where the histogram 
function is obtained from the signal generated by the camera 56. The characteristic curve 
of the exposure sensitivity corresponds to the cumulative distribution function) from at 
least a part of the scene registered by the at least one image sensor (Fig. 1A-IC, page 4 lines 
23-24, 1A through IC are images depicting an office scene captured at different exposure 
settings. The image sensor corresponds to the Kodak DC-488 camera which has the up 
and down exposure sensors (see page 1 line 25)), so that, when a gray value wedge having 
two segments with different gradients of the gray values is registered as the scene (Fig. 1 A-IC, 
page 4 lines 23-24, the office scene captured at different exposure settings have different 
gradients of the gray values) the at least one image sensor generates an image nearly free of 
apparent contours (Fig. 6, page 5 lines 8-1 1, FIG. 6 is a composite image produced from 
the bracketed images(set of images of a static scene captured at different exposures) of 
the office scene of FIGS. 1A through 1C that exhibits a more uniform exposure and tone 



Application/Control Number: 10/542,672 Page 9 

Art Unit: 2624 

than any of the bracket images. The image nearly free of apparent contours corresponds to 
the composite image Fig. 6). 

As to claim 17, Szeliski teaches the characteristic curve of the exposure sensitivity (Fig. 
9A, page 5 lines 23, the graph of a cumulative distribution function) is adjusted as a 
function of a determined optimal characteristic curve of the exposure sensitivity (Figs. 9A -9C 
page 5 lines 27-29, a blended cumulative distribution function FIG. 9C is produced by 
blending the cumulative distribution function FIG. 9A with the straight line function FIG. 
9B. The determined optimal characteristic curve of the exposure sensitivity corresponds to 
blended cumulative distribution function FIG. 9C), including a determined characteristic 
curve of the exposure sensitivity which is optimal according to information theory (Fig.lB, a 
straight line distribution function generates uniform distribution. Thus, theoretical 
distribution function optimal according to information theory corresponds to the straight line 
distribution function), at least one of the optimal characteristic curve of the exposure 
sensitivity (Fig.9c) and the characteristic curve of the exposure sensitivity which is optimal 
according to information theory (Fig, 9B) being determined as a function of image signals (Figs. 
9A-9C, the Figs. 9A through 9C are plotted as a function of image signal generated by the 
camera56) from the at least one image sensor (page 5 line 31 and page 6 lines'! -2, Fig. 18A 
is a composite image produced from the bracketed images of the office scene of FIGS. 
1A through 1C using the up and down exposure sensors of the Kodak DCS camera (see 
page 1 line 25).The image sensor corresponds to the Kodak DCS which has up and down 
exposure sensors 56). 
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As to claims 18, Szeliski teaches determining the optimal characteristic curve of the 
exposure sensitivity as a function of a histogram of the gray values (page 13 lines 8-9, page 14 
lines 16-17, histogram equalization is a process for mapping pixel brightness values of 
an image to approximate a uniform distribution. A cumulative distribution function is 
computed using the summed brightness histogram to determine the uniform distribution. 
Further if the images are black and white, then the standard pixel gray levels would 
preferably be used as the measure of pixel brightness (see page 16 lines 26-28). The 
characteristic curve of the exposure sensitivity corresponds to the cumulative distribution 
function curve (Fig.9A), and the optimal characteristic curve of the exposure sensitivity 
corresponds to Fig. 9C and which is obtained by blending the cumulative distribution 
function Fig. 9A with the straight line function Fig. 1B (page 15 lines 24-25) of at least one 
image and/or of at least one image detail (Fig. 1 A-IC: FIGS. 1 A through IC are images 
depicting an office scene captured at different exposure settings. Thus FIGS. 1A through 
IC have different image detail, and optimal (page 15 line 27-29)) 

approximating the characteristic curve of the exposure sensitivity (page 15 lines 24-25, 
blending the cumulative distribution function Fig. 9A with the straight line function Fig. 
9B) to the determined optimal characteristic curve of the exposure sensitivity (page 16 lines 4-6 
the blending process is carried out in order to determine the optimal cumulative 
distribution function (see Fig.9C) that represent the composite image (Fig. 1 0B) having 
the best possible improvement in exposure and tone uniformity. The optimal characteristic 
curve of the exposure sensitivity corresponds to the blended cumulative distribution 
function Fig. 9C), including approximation of the characteristic curve of the exposure sensitivity 
to the determined optional characteristic curve of the exposure sensitivity through at least on 
numerical approximation method and/or at least one segmenting method (Fig. 7B shows the 
steps of obtaining the optimal cumulative distribution function using numerical 



Application/Control Number: 10/542,672 Page 11 

Art Unit: 2624 

approximation that includes Normalization, Curve fitting, Histogram Equalization, Partial 
Equalization). 

As to claim19, Szeliski teaches at least one of the gain (Fig. 9A, the slope the 
cumulative distribution function graph that measure the uniformity of an image), the 
offset, the integration time and at least one additional parameter (page 14 lines 16-17, the 
characteristic pixel value which is pixel brightness values of an image ) for adjusting the 
characteristic curve of the exposure sensitivity (page 14 lines 28-22, see also step 714, the 
pixel brightness values are adjuster in ordered to approximate the cumulative 
distribution function. The characteristic curve of the exposure sensitivity corresponds to the 
cumulative distribution function graph) of the at least one pixel of the at least one image 
sensor (Figs. 1A-1C the approximation is carried out by adjusting exposure and tone of 
the set of images (Figs. 1 A-1C) captured at different exposure using the exposure 
sensors of the Kodak camera (see page 1 line 25) is adjusted, the at least one additional 
parameter for adjusting the characteristic curve of the exposure sensitivity being at least one of 
(i) at least one parameter for adjusting the number of segments of the characteristic curve of the 
exposure sensitivity (Fig. 7B, adjusting the summed e brightness values of values of an 
image), (ii) at least one parameter for adjusting the position of the segments of the 
characteristic curve of the exposure sensitivity, (iii) at least one parameter for adjusting the size 
of the segments of the characteristic curve of the exposure sensitivity, and (iv) at least one 
parameter for adjusting the at least one function(page 15 lines 18-28, blend the normalized 
cumulative distribution function with a straight line function. The at least one function 
corresponds to the linear function (Fig. 9B), at least one parameter corresponds to the 
pixel brightness values of an image that is used to approximate a uniform distribution of 
cumulative distribution function (page 13 lines 9-10). 
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As to claim 20, Szeliski teaches at least one of the functions is a linear function (Fig.9B). 

As to claim 21 , Szeliski teaches the characteristic curve of the exposure sensitivity of the 
at least one pixel of the at least one image sensor is adjusted as a function of image signals 
(page 13 lines 8-18, histogram equalization is a process for mapping pixel brightness 
values of an image to approximate a uniform distribution. Thus, distribution function is 
adjusted based on the image signal generated by camera 56) from at least two image 
sensors, including at least one stereo camera (page 1 lines 21-25, FIGS. 1A through IC show 
three images of an office desk and window, taken at different exposures. Specifically, 
these images were captured with a Kodak DCS camera, by adjusting the exposure up and 
down by two "stops"). 

Regarding claims 22-27, all claimed limitation are set forth and rejected as per 
discussion for claims 15-21 . 

As to claim 28, Szeliski teaches A computer program executable on a computer (Fig. 2 
page 7 lines 5-18, and page 23 claim 13), comprising: a program code arrangement (page 23 
claim 13); 

Regarding the remaining section of claim 28, all claimed limitation are set forth and 
rejected as per discussion for claim! 

Regarding claims 29-34, all claimed limitation are set forth and rejected as per 
discussion for claims16-21 . 
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Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant 
is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 
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